Pegasus: Mapping Scientific Workflows onto the Grid
نویسندگان
چکیده
In this paper we describe the Pegasus system that can map complex workflows onto the Grid. Pegasus takes an abstract description of a workflow and finds the appropriate data and Grid resources to execute the workflow. Pegasus is being released as part of the GriPhyN Virtual Data Toolkit and has been used in a variety of applications ranging from astronomy, biology, gravitational-wave science, and high-energy physics.
منابع مشابه
Pegasus: A framework for mapping complex scientific workflows onto distributed systems
This paper describes the Pegasus framework that can be used to map complex scientific workflows onto distributed resources. Pegasus enables users to represent the workflows at an abstract level without needing to worry about the particulars of the target execution systems. The paper describes general issues in mapping applications and the functionality of Pegasus. We present the results of impr...
متن کاملWings for Pegasus: A Semantic Approach to Creating Very Large Scientific Workflows
Scientific workflows are being developed for many domains as a paradigm to manage complex scientific computations. In our work, we are challenged with efficiently generating and validating workflows that contain large amounts (hundreds to thousands) of individual computations to be executed over distributed environments. We describe a new approach to workflow creation and validation that uses s...
متن کاملProvenance trails in the Wings/Pegasus system
Our research focuses on creating and executing large-scale scientific workflows that often involve thousands of computations over distributed, shared resources. We describe an approach to workflow creation and refinement that uses semantic representations to 1) describe complex scientific applications in a data-independent manner, 2) automatically generate workflows of computations for given da...
متن کاملPegasus and DAGMan From Concept to Execution: Mapping Scientific Workflows onto Today's Cyberinfrastructure
In this chapter we describe an end-to-end workflow management system that enables scientists to describe their large-scale analysis in abstract terms, then maps and executes the workflows in an efficient and reliable manner on distributed resources. We describe Pegasus and DAGMan and various workflow restructuring and optimizations they perform and demonstrate the scalability and reliability of...
متن کاملPegasus on Virtual Grid: A Case Study of Workflow Planning over Captive Resources
As scientific applications in a variety of disciplines are being actively studied and computing environments become more complicated and dynamic, a challenge is how to leverage existing cyber-infrastructures and achieve robust and efficient computing. This paper presents a case study on planning and executing application workflows over provisioned resources. This work integrates the Pegasus wor...
متن کامل